Process for generating images with realistic modifications

ABSTRACT

A method for generating an output image with realistic individual text inserts via software loaded on a computer is provided. The method comprises the steps of providing a base image in a commercial graphical format with at least one position frame defined within the base image; the position frame defines an area within the base image where a text insert is insertable; providing software loaded on the computer which transforms a low resolution image into a high resolution image; defining a vector path within the position frame; arranging the text insert along the vector path; composing the text insert wherein the such step comprises the steps of selecting individual elements, sizing the individual elements as a function of the vector path, assembling the elements into letters, and assembling the letters along the vector path to compose the text insert; and entering text of the text insert via a user interface.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a divisional patent application of U.S. patent application Ser. No. 10/886,775, filed on Jul. 7, 2004, now U.S. Pat. No. 8,121,388 the entire contents of which are incorporated herein by reference.

STATEMENT RE: FEDERALLY SPONSORED RESEARCH/DEVELOPMENT

Not Applicable

BACKGROUND OF THE INVENTION

The present invention relates generally to a personalized printed postcard, mailing or output image file, and more particularly to a personalized printed postcard, mailing or output image wherein a personal message appears to be a natural element within a background.

In the advertising industry, there is a growing need for individualization/personalization of various advertising materials such as Christmas cards, mail shots and other similar mailings. Typically, in the advertising industry the personalized mailings are sent to numerous individuals within a community in a single mailing (i.e., mass mailing or batch processing). In this regard, each mailing may be associated with a specific data record within a database. Each data record is read and inserted into a base image. Accordingly, in the professional advertising sector, this creates a personalized mailer. Nonetheless, this method of personalizing the mailing creates an impression that the text of the personal message is computer generated and a part of a mass mailing program.

For example, German Application Publication 43 28 908 discusses a process by which an advertising message or individual text is printed on greeting cards. Although the process discussed in the German publication provides for printing individual cards and outputting image files, the personalized message may only be printed on a part of the image or in a separate box. Further, if the text of the personalized message is unacceptably long, either the text is not accepted or the text is printed outside the visually printable area. Accordingly, this process produces an image which is visually unsophisticated.

To achieve a visually sophisticated image, a complex graphics program must be utilized, such as that described in the comparison test “Mathematical Beauties”, Volume 2001, page 142 ff. The operation of such complex graphics program even with simplifying the program to rapidly generate an output image, is too difficult for lay persons to operate and does not allow the production of mass mailings with personalized messages matched to the background.

Accordingly, the object of the invention is therefore to create a process for generating an output image file in which maximum visual attractiveness is achieved and alternate features are unincorporatable with the output to increase the attractiveness of the outputted image may be processed automatically. A further object of the invention is to create hardware and software to implement the process.

BRIEF SUMMARY OF THE INVENTION

In accordance with the present invention, there is provided a process by which a highly attractive output image file is produced. In this regard, the output image file comprises a base image and a personalized message. The base image is a background of the output image such as a picture of a park, national landmark, or any other appropriate scenery or motif. The personalized message is typically a string of text which may be customized to an individual or entity (e.g., name, address, and/or message). Generally, in an aspect of the present invention, the personalized message is overlaid onto the base image to provide an output image file to create an attractive output image.

In another aspect of the present invention, the personalized message may appear realistic in that the personalized message may appear to be an integral part of the base image. For example, if the base image is a picture of a park in autumn with leaves of trees fallen on the ground, the personalized message may be formed by aligning the fallen leaves on a grass landscape such that it would appear that a person had arranged the leaves to form the words of the personalized message and had taken a picture of the park with the arranged leaves. Other visual effects may also be incorporated into the output image which provides additional variation and attractiveness to the output image. For example, the personalized message may appear to be a message written in sand with a finger, message written in snow of a winter landscape, message chiseled in brickwork of a famous building, or other similar types of adaptations to the background. Other features which may be incorporated into the personalized message is kerning where letters may be placed next to each other such that a first letter may undercut a second letter. Not only may the personalized image be formed from images in the background such as autumn leaves, the autumn leaves themselves may be randomly placed about and on the personalized message and on the personalized message to provide the impression that the personalized message was naturally formed by wind or that someone had arranged the leaves to produce the text. Moreover, a shadow effect may be imparted onto the personalized message to further enhance the realistic effect of the output image file.

Other variations to further enhance the realistic impression of the output image file may include random orientation of the background elements of the base image used to form the letters of the personalized message. Additionally, the background elements forming the message may appear to be moving. For example, the message may appear to have formed while the autumn leaves were falling off the trees as the message is formed with the addition of movement lines. These as well as other visual effects may be incorporated into the output image file to create a highly attractive and realistic personalized message.

As stated above, the output image file comprises a base image and a personalized message. In this regard, the base image may define a position frame in which the personalized message is inserted. The frame defines the outer limits in which the personalized message (i.e., text string) must fit. In the frame, a vector path is defined and along this vector path background elements of the base image or other elements may be aligned and arranged to form the words of the personalized message.

BRIEF DESCRIPTION OF THE DRAWINGS

An illustrated and presently preferred embodiment of the present invention is shown in the accompany drawings in which;

FIG. 1 is an output image illustrating a personalized message inserted into a base image;

FIG. 2 is a simplified block diagram of an embodiment of a process of the present invention; and

FIG. 3a-3e a detailed process of steps 120, 130, and 140 of the process shown in FIG. 2.

DETAILED DESCRIPTION OF THE INVENTION

In an aspect of the present invention, a personalized message 10 or text component may be inserted into a base image 12. For example, as shown in FIG. 1, the personalized message “EVERYTHING IS POSSIBLE” is inserted into the base image (i.e., building steps with pigeons). In this regard, the various aspects of the present invention may be embodied in a computer loaded with software to produce a highly personalized and realistic image which may be viewed on a computer monitor or printed on paper (i.e., output file).

As stated above, the personalized message or text component may be inserted into the base image. In particular, the personalized message may be inserted into a position frame 14 which is defined by an area within the base image. By way of example and not limitation, the personalized message may be a text string. Further, it is also contemplated within the scope of the present invention that the personalized message may be other image elements (e.g., autumn leaves), lines or other elements. Accordingly, the personalized message may correspond with the motif of the base image. For example, the motif of the base image may be sand, snow, brickwork or autumn leaves and respectively, the personalized message may resemble words written in sand by a person's finger, words written in snow by a person's finger, brickwork of a famous building chiseled out to give the impression of an inscription in such brickwork, or autumn leaves arranged on grass to form the words to give the impression that a person had arranged the leaves. These motifs (e.g., sand, snow, brickwork, and leaves) are provided by way of example and not limitation. In this regard, it is contemplated within the scope of the present invention that the base image may resemble other motifs with corresponding personalized messages.

For the selected base image and inserted personalized message, the scaling and adaptation of the personalized message may be accomplished independently of each other. Further, for personalized messages that cannot fit on one line within the position frame, a line break may be inserted in the text string such that words may be distributed on a second line within the position frame evenly. Preferably, the line break may be inserted right before the words pass the outer limits of the position frame. Moreover, when the number of lines exceed the maximum height of the position frame, then individual components (i.e., autumn leaves) that make up the letters of the words may be scaled down or otherwise reduced by a pre-defined maximum scaling factor (e.g., minimum word size) to guarantee legibility of the words.

The text string of the personalized image may be confined within the position frame. For example, a personalized message may be written on a Brandenburg Gate on a postcard, and in this regard, the position frame may be positioned and limited to the structural features of the Gate. Accordingly, the text of the message should not extend beyond the building. This confinement of the personalized message to the Gate (i.e., position frame) is achieved by adapting an element (i.e., letters are comprised of elements or individual components) size to a resulting text size which is generated from a vector path adapted to the position frame. The size of the elements to be placed on the vector path is matched to the detail of the vector path.

A safety routine may be implemented in the computer and software such that a user may be warned if the text string is too long such that the personalized message cannot fit within the position frame with a size greater than the minimum word size to ensure legibility. Further, in a batch process of inserting personalized messages (i.e., data records) into respective base images, those personalized messages which cannot be inserted into the position frame of the base image and maintain a minimum height may be earmarked for manual processing in which a solution may be developed such as using abbreviations.

In another aspect of the present invention, a realistic personalized message inserted into a base image may be generated wherein realistic in this context means that the viewer of the output image has an illusion that the inserted personalized message was a part of the image from the outset (e.g., autumn leaves forming text). Moreover, it is contemplated within the scope of the present invention that realistic labeling of pictures may be automatically generated. In contrast, in the prior art, a realistic personalized message may not be achieved. Rather, the know applications only inserts the personalized message in the base image without any process of generating a realistic personalized message. Further, in the prior art, if a realistic personalized message was desired, then the user manually adapted the personalized message with the background (e.g., motif) of the base image to create the realistic personalized message.

In another aspect of the present invention, the software loaded on the computer may be designed for mass print runs (i.e., batch runs) of a base image with a plurality of personalized messages or for mass print runs of a plurality of different base images with a plurality of respective personalized messages. In this regard, a printer may be attached to the computer. The base image may be translated into a language of the printer only once such that lengthy calculations are omitted during processing of the batch run even if the base image contains complex graphics. For each print job, only the personalized message is converted into control codes for the printer. Further, this process can be repeated for each different base image and corresponding personalized messages. Accordingly, rapid processing of batch runs are made possible by the present invention.

More particularly, an image generation unit may automatically determine which points of the base image have been changed by the inserted personalized message. An extract image of the changed points (i.e., changed area) may be stored for each output image containing all changes and with its corresponding position data. On printing, the base image is calculated only once by the Raster Image Processor (RIP) to make ready the base image for printing. When the ouput image with the inserted personalized message is sent to the printer, then the calculated base image is printed on the page and only the extract image is placed over the printed base image with a precise fit. Thereafter, for each personalized message, only the extract image is calculated by the RIP. This increases the printing speed usually by a factor of two (2) to (five) 5 and reduces the print file by about the same factor.

In another aspect of the present invention, the letters forming the words of the personalized message may be automatically selected from a list of alternative letter designs. In particular, each letter within the alphabet may have three alternative designs. A first design may have a transition point at a lower portion of the letter. The transition point is where the letter may be connected to an adjacent letter. A second design may have a transition point at a middle portion of the letter. And, a third design may have a transition point at an upper portion of the letter. As such, for example, if the personalized message contained the name “Sylvia”, the software randomly selects an “S” from a spline vector font formed by a multiplicity of individual letters. Thereafter, the software selects the appropriate alternative designs for the letter “y” that would smoothly connect with the selected S. The most appropriate alternative design for the letter “y” may have a initial point closest to the terminal point of the selected “S”. Further, optionally, the selected “y” may be merged with the selected “S” to further provide an illusion that Sylvia was handwritten.

The letters of the personalized message may be adapted to resemble a particular typeface. This may be a font where each letter is formed from a plurality of images (e.g., footprint in snow) or each letter is formed by an image (e.g., cake letters). Further, each typeface may have alternative designs for the same letter.

A kerning technique for conventional vector writing may be employed for a text string of the personalized message. In particular, each letter has a Step Kerning so that the letters can be placed next to each other such that undercuts are possible. For example, a small “a” may be slipped under a large “T” because the horizontal bar of the T would not protrude into the “a”.

Decorative elements may also be inserted and arranged next to the text of the personalized message to additionally create the illusion of a realistic personalized message. For example, if a base image is that of a park with grass, a position frame is located in the grass area, and words of a personalized message were written with fallen leaves of a tree, then forming the words with the leaves on the grass without any other leaves on the grass would make the output image appear computer generated. Accordingly, other leaves (i.e., decorative elements) may be inserted on or adjacent the words of the personalized message to give the realistic impression that a person had arranged the leaves to form the words on the grass.

Elements 16 (see FIG. 1) may also be rotated along the vector path. For example, if the words of the personalized message were formed with straws, then it would appear to be unnatural if each straw were positioned vertically. As such, each straw may be placed along the vector path with slight angular deviations.

To further enhance the realism of the output image, another visual effect that may be incorporated into the process is to incorporate a shadow effect on the words/text of the personalized message. To this end, a solarization direction may be established. When arranging or inserting the personalized message into the position frame of the base image, the software additionally retrieves a solarization direction associated with the base image. The association between the base image and solarization direction may be predefined based on the selected base image or may be manually selected by a user. Once the solarization direction has been determined, the software then adds the extra shadow effect to the personalized message as a function of this solarization direction. In this regard, the output image (i.e., base image with the personalized message inserted into the position frame) is constructed with a layer technique wherein the back of the output image is constructed first and then the front is constructed such that the shadows are covered by the elements, or in other words, are arranged in perspective such that the elements are in front and their shadows in the back. As with know programs, a technique with two planes may be used. In one plane, pixel areas are defined which may be described as the images being further built up. In the second plane, the actual image is arranged.

For some of the visual effects discussed above, it is necessary to define a curve along which individual components are arranged to form the personalized message. In this regard, the personalized message may be constructed with individual components such as lines, images, letters, background parts or pure text components. For example, images may be footprints, shoeprints, matches and/or butterflies. Background parts of the pixilated base image may be used if the personalize message is to be simulated in the base image such as when the personalized message appears to be a message written in sand. Further, using the shadow function discussed above, a solarization direction may be defined and the direction from which light falls on the objects of the base image and the shadow from the individual components may be calculated and added to the output image.

In another aspect of the present invention, incorporation of curve technology into the output image is also possible wherein the individual components/elements are uniquely aligned. In particular, a Bezier curve defines a plurality of nodes. At each node of the curve, a tangent gradient may be determined and the individual components may be inserted and aligned to this gradient. For example, if a name of a person is to be shown by footprints in sand, the footprints may be aligned by arranging their longitudinal direction parallel to the tangent gradient/direction. Further, depending on the motif of the base image selected, instead of placing the individual components at a fixed angle of 0 degrees relative to the tangent direction, a different fixed angle may be selected or the angle may be randomly selected for each adjacent individual component. For example, randomizing the angle at which the individual components are inserted into the position frame with respect to the tangent direction discussed above may be incorporated into the output image when the personalized message is constructed with an arrangement of leaves of a tree.

In another aspect of the present invention, additional movement lines may be incorporated into the personalize message to impart an impression that the individual components (e.g., leave) were in motion when the output image was photographically taken. For example, the movement lines may provide an illusion that fallen autumn leaves formed the personalized message as the autumn leaves were falling off the trees or that a flock of birds moved into formation to form the personalized message. To this end, the individual components may be blurred on a side opposite the direction of movement. For example, if the personalized message is formed to impart an illusion that the personalized message was formed as the autumn leaver were falling, then the blurring of the individual components (e.g., autumn leaves) may be located on an upper side of the autumn leaves.

In another aspect of the present invention, the individual component may be associated with a typeface. For example, the typeface may be background areas of the base image or constructed from independent images. The typeface may also be a true type font (TTF) if a true type font is generated, the inputted text may easily be arranged within the position frame.

An impression that the individual component have been embossed or indented into the base image may also be imparted onto the base image. To form this three-dimensional effect, peripheral edges of the individual component text string may be darkened or lightened. For example, the individual components may be ASCII symbols which may be generated from background areas of the base image to form the three-dimension of effect described above. In the alternative, the ASCII symbols may be constructed from independent image elements which are arranged adjacent to each other or overlap each other to form the ASCII symbols. Further, the ASCII symbol may also be generated from a entire image. For example, the ASCII symbol may have a form of a watercourse, a snake or a rope which may be curved to form the letters of the personalized message/individual components. The ASCII symbol may also be matches arranged to compose the letters of the personalized message.

The individual components are arranged such that they are overlapping with each other or separate from each other. In the latter, the spacing between the individual components may not be too great otherwise the effect of a cohesive writing would be lost. In addition to arranging the individual component to form the letters of the personalized message, additional images of the individual components may be distributed over the position frame to further enhance the realistic nature of the output image. For example, additional fallen leaves may be arranged around a personalized message formed with fallen leaves. The additional individual components distributed in the position frame may also be randomly distributed in a predetermined density such that the position frame does not appear as an unnatural/foreign object on the grass. With the additional individual components (e.g., autumn leaves) randomly distributed over the position frame in a predetermined density, the legibility of the personalized message must still be retained. To this end, edges of the individual components or letters of the personalized message may have a lower density definition (i.e., lighter) or be kept clear of the additional individual components.

Typically, as discussed above, the position frame 14 (see FIG. 1) has a transparent background such that the base image is still viewable through the position frame except for the portion of the position frame that is changed by the letters of the personalized message. In the alternative, it is possible to provide a position frame with a different or personalize or individual background to achieve the effect of a shield (i.e., a second background). For example, if the individual components are ASCII symbols, then these symbols can be broken down into linear part sections and each of these linear part sections may be depicted by one or more images. In this regard, bars or matches may be selected.

Typically, the individual components are constructed with image elements or text strings which may be inputted automatically into the position frame. Moreover, a plurality of text strings may be stored in a database such that each individual component may be automatically inputted into the position frame by software. In this regard, a system may be constructed wherein a mass mailing may be produced. Alternatively, the text string may be entered manually via a computer keyboard. In this regard, instead of storing a plurality of text strings in a database and automatically inserting each of the text strings of the database into a position frame, the individual component/text string may be inserted into the position frame as the text string is being entered via the keyboard. For example, a self service machine may be erected at a tourist site such that the tourist may enter a text string via the keyboard to produce an output image (i.e., resulting product) with the typed text string integrated into the base image.

The aspects of the present invention may also be used to generate a standard letter. For example, a computer network may be implemented such that a graphics program incorporating the various aspects of the present invention discussed above is installed on a server computer. The server computer may have a sufficiently high computing power to perform the calculations required to accomplish the various effects and aspects discussed above. The server computer may be connected to an operator's computer via a normal data line such as an internet line such that the various aspects of the present invention is performed as part of an internet application. In this regard, a powerful intranet or separate client/server application may also be used.

The computer network discussed above may have an output unit (e.g., printer or computer monitor) attached thereto. Depending on the computing power of the computer network, the printer may print the entire output image or only the position frame. Typically, the printer prints only the position frame if the server computer does not have sufficient computing power to timely provide the output image to a user of the graphics program. For example, a low power computer may be used in the self service machines discussed above and a preprinted card (i.e., card printed with the base image) may be used in the self service machine. Thereafter, the self service machine may be equipped with a printer which only prints the position frame. This method of printing the resulting product may lead to inaccuracies depending on the quality of the paper, quality of the printer, print quality, and paper guide. Accordingly, a sufficiently powerful computer system is preferred such that the output image may be entirely generated by the computer system and the complete letter or greeting card printed.

The graphics program incorporating the various aspects of the present invention discussed above may require greater computing power than that which may be provided by a single computer. In this regard, a network of computers may be used to break down the computing tasks required to generate the output image, assign those individual tasks to the individual computers within the network of computers, receive the calculated results, and assemble those results into the final output image file. Moreover, a server of the computer network may also insure that a task assigned to a particular computer within the computer network is assigned to a different computer if the computer originally assigned to perform the task fails in any way.

When a network of computers is used, a lower resolution depiction of the base image with the position and size of the position frame may be transmitted to the client computer. The user via a keyboard of the client computer may enter the text string/personalized message. The inputted text string is then transmitted to the server and the server produces a high resolution output image file and the output image file is sent to the output unit.

Instead of sending the high resolution output image file to a printer, the file may be electronically sent as an email attachment to a database of emails (i.e., mass email) or to a single email (i.e., personal electronic postcards).

Referring now to FIG. 2, the same illustrates a general overview of the process to create the final output image incorporating the various aspects of the present invention discussed above. As shown in step 100, a base image is first selected which may be predetermined or alternatively, the user may be able to choose a base image from a list of base images.

After the base image is loaded, the position frame (i.e., box) is defined in step 110. In a simple system such as the self service machine discussed above, the user of the self service machine may not be provided with the option of manipulating or changing the actual location of the position frame within the base frame. For complex systems such as those used by advertising agencies desiring to produce a mass mailing, the user may be given the ability to manipulate the position frame with respect to its location and size such that the user may be better able to determine the text string length to be inserted into the position frame. Even though the user may be given the option to otherwise manipulate/adapt the position frame, the extent of the manipulation/adaptation may be restricted or controlled. For example, only particular areas of the base image may be released for overlaying with the position frame. Further, there may be several position frames where individual components may be inserted by the user.

After the position frame has been defined, the user inputs the text string via a computer keyboard into the position frame in step 120. If there are several position frames, then the process of inputting the text string is repeated until all necessary inputs have been made. The position frame is then filled in step 130 and an output image file is sent to an output unit (step 140) such as a printer or email addresses. For mass output, this process discussed above may be repeated until all data records within the database have been processed.

Referring now to FIGS. 3a-3e , the same illustrates a detailed view of the process steps 120, 130 and 140 as shown in FIG. 2. In particular, as shown in FIG. 3a , in step 150, an input is provided which comprises (1) group of pixel-picture-clips (per each clip picture, mask and mask shadow to exist), (2) path based vector font (no outline) with defined connection and return point, (3) frame which defines the area for the text calculation on an existing bitmap, and (4) text that is intended for output (taken out of a database of all persons, for whom pictures shall be calculated). Thereafter in step 152, on basis of the text information, a vector text is generated out of the individual letter definitions. In step 154, as shown in FIG. 3b , letter pairs with adequate connection points are automatically found (several alternative designs of a letter exists when using written characters). In step 156, step kerning with consideration of the rotation angle of every single letter and the actual clip-size is calculated.

In step 158, a decision is made whether the text fits into the frame. If the text does not fit into the frame, then in step 160, using all of the obtained parameters, the height of the available frame is reduced until text is legible. Then in step 162, all parameters depending on the overall size (e.g., clip size, clip offset, random deviation of position, motion, blur) are adjusted to the new size. Thereafter, in step 164, as shown in FIG. 3c , the information on the drawing path is used to generate a vector. In the alternative, if the text does fit into the frame then in step 164, the information on the drawing path is used to generate a vector.

In step 166, the drawing path vector is transformed (perspective deformation for adjustment to the situation of the picture). In step 168, the individual pixel-clips are placed along the path under consideration of the perspective (size) and inclination (rotation angle).

As shown in FIG. 3d , step 170 is the step of filtering of every single clip on the path. In step 172, as shown in FIG. 3e , the result is a completed bitmap (+alpha channel), which now includes the inputted text as photorealistic image. In step 174, additional clips are set under consideration of the already drawn clips (for ornamentation of the picture). In step 178, the output is a completed bitmap for a name. This process shown in FIGS. 3a-3e is repeated for every name out of a database.

This description of the various embodiments of the present invention is presented to illustrate the preferred embodiments of the present invention, and other inventive concepts may be otherwise various embodied and employed. The appended claims are intended to be construed to include such variations except insofar as limited by the prior art. 

What is claimed is:
 1. A method for outputting images, the method comprising the steps of: receiving a base image and a plurality of personalized messages, wherein a personalized message is formed from elements consisting of at least two pixels found in the base image; converting the base image only once into control codes of a printer, the control codes used for printing; converting each of the plurality of the personalized messages into control codes of the printer; sending the control codes for the base image and the personalized messages to the printer for printing; for each personalized message: using the control codes for the base image, causing the base image to be printed on a page; and using the control codes for the personalized message, causing the personalized message to be printed as overlaid onto the base image.
 2. The method according to claim 1, where one of the personalized messages comprises a text insert.
 3. The method according to claim 1, wherein the base image and the personalized messages are converted into the control codes of the printer by a raster image processor.
 4. The method according to claim 1, wherein data for the personalized messages are inputted into at least one computer.
 5. A system for outputting images, the system comprising at least one data processing unit and a storage memory comprising software to execute the steps of: receiving a base image and a plurality of personalized messages, wherein a personalized message is formed from elements consisting of at least two pixels found in the base image; converting the base image only once into control codes of a printer, the control codes used for printing; converting each of the plurality of the personalized messages into control codes of the printer; sending the control codes for the base image and the personalized messages to the printer for printing; for each personalized message: using the control codes for the base image, causing the base image to be printed on a page; and using the control codes for the personalized message, causing the personalized message to be printed as overlaid onto the base image.
 6. A non-transitory storage memory comprising software to execute the steps of: receiving a base image and a plurality of personalized messages, wherein a personalized message is formed from elements consisting of at least two pixels found in the base image; converting the base image only once into control codes of a printer, the control codes used for printing; converting each of the plurality of the personalized messages into control codes of the printer; sending the control codes for the base image and the personalized messages to the printer for printing; for each personalized message: using the control codes for the base image, causing the base image to be printed on a page; and using the control codes for the personalized message, causing the personalized message to be printed as overlaid onto the base image. 